Scarlett Johansson and Colin Jost are back on

They were spotted at the Palm at the Huntting Inn in East Hampton, NY "looking cozy on a love seat."